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WHAT IS CLAIMED IS: 

1. An image processing apparatus for processing 
electronic image data obtained by image pickup operation via 
5 an optical system, the image data having two-dimensionally- 
arranged pixel data in the row direction and the column 
direction, the image processing apparatus comprising: 

a memory that stores the image data at least before 
image processing and further stores the image data after the 
10 image procession; 

a first data-order converting unit that reads the pixel 
data in units of a block of the two-dimensional arrangement 
of the image data via a bus from the memory and thereafter 
outputs the pixel data in the block in the column direction; 
15 an image processing unit that is connected to the first 

data-order converting unit so that a pipeline processing can 
be performed via an information sending channel different 
from the bus, inputs the image data outputted in the column 
direction from the first data-order converting unit, 
20 performs the image processing, and thereafter outputs the 
image data in the column direction; and 

a second data-order converting unit that is connected 
to the image processing unit so that a pipeline processing 
can be performed, converts the image data outputted in the 
25 column direction from the image processing unit into the 
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image data in the row correction, and outputs the converted 
image data . 

2. The image processing apparatus according to Claim 1, 
wherein the first data-order converting unit can change the 
size at least one of the image data in the row direction and 
the image data in the column direction read from the memory 
in units of a block. 

3. The image processing apparatus according to Claim 1, 
wherein the image data before the image procession is any of 
the following; image pickup data that is obtained by 
photoelectrically converting, by image pickup means, a 
subject optical image formed by the optical system and 
outputted; non-compressed image data that is the image 
pickup data subjected, as occasion demands, to predetermined 
processing, excluding compressing processing; and compressed 
image data that is obtained by compressing processing after 
performing predetermined processing on the image pickup data, 
excluding the compressing processing, as occasion demands. 

4. The image processing apparatus according to Claim 2, 
wherein the image data before the image procession is any of 
the following; the image pickup data that is obtained by 
photoelectrically converting, by image pickup means, a 
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subject optical image formed by the optical system and 
outputted; non-compressed image data that is the image 
pickup data subjected, as occasion demands , to predetermined 
processing, excluding compressing processing; and compressed 
image data that is obtained by compressing processing after 
performing predetermined processing on the image pickup data, 
excluding the compressing processing, as occasion demands. 

5. The image processing apparatus according to Claim 1, 
wherein the image processing unit comprises a distortion 
correction processing unit that corrects the distortion 
aberration due to the optical system. 

6. The image processing apparatus according to Claim 4, 
wherein the image processing unit comprises a distortion 
correction processing unit that corrects the distortion 
aberration due to the optical system. 

7. The image processing apparatus according to Claim 5, 
wherein the distortion correction processing unit comprises: 

an interpolating-coordinate generating unit that 
generates interpolating coordinates; 

an inner memory unit that partly stores the image data; 

and 

an interpolation calculating unit that generates pixel 



- 98 - 



data of interpolating coordinates from image data stored in 
the inner memory unit based on the interpolating coordinates 
generated by the interpolating-coordinate generating unit. 

5 8. The image processing apparatus according to Claim 6, 

wherein the distortion correction processing unit comprises: 

an interpolating-coordinate generating unit that 
generates interpolating coordinates; 

an inner memory unit that partly stores the image data; 

10 and 

an interpolation calculating unit that generates pixel 
data of interpolating coordinates from image data stored in 
the inner memory unit based on the interpolating coordinates 
generated by the interpolating-coordinate generating unit. 

15 

9. The image processing apparatus according to Claim 7, 
wherein the interpolating-coordinate generating unit 
comprises : 

an interpolating-position generating unit that 
20 generates coordinates of a pixel of an interpolating target 
in the image after correction of the distortion; and 

a distortion-correcting-coordinate converting unit that 
obtains coordinates in the image before correction of the 
distortion , corresponding to the coordinates generated by 
25 the interpolating-position generating unit. 
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10. The image processing apparatus according to Claim 

8, wherein the interpolating-coordinate generating unit 
comprises : 

5 an interpolating-position generating unit that 

generates coordinates of the pixel of an interpolating 
target, in the image after correction of the distortion; and 
a distortion-correcting-coordinate converting unit that 
obtains coordinates in the image before correction of the 
10 distortion, corresponding to the coordinates generated by 
the interpolating-position generating unit. 

11. The image processing apparatus according to Claim 

9, wherein the interpolating-coordinate generating unit 
15 further comprises a selector that selects either of the 

coordinates generated by the interpolating-position 
generating unit or the coordinates obtained by the 
distortion-correcting-coordinate converting unit, and 
outputs the selected coordinates to the interpolation 
20 calculating unit. 



12. The image processing apparatus according to Claim 
10, wherein the interpolating-coordinate generating unit 
further comprises a selector that selects either of the 
25 coordinates generated by the interpolating-position 
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generating unit or the coordinates obtained by the 
distortion-correcting-coordinate converting unit, and 
outputs the selected coordinates to the interpolation 
calculating unit. 

5 

13. The image processing apparatus according to Claim 

9, wherein the distortion-correcting-coordinate converting 
unit obtains coordinates in the image before correcting the 
distortion, corresponding to the coordinates generated by 

10 the interpolating-position generating unit, by using a 
predetermined correcting formula including a polynomial 
obtained by linearly combining the integer power of the 
distance from the center of distortion to the interpolating 
position. 

15 

14. The image processing apparatus according to Claim 

10, wherein the distortion-correcting-coordinate converting 
unit obtains coordinates in the image before correcting the 
distortion, corresponding to the coordinates generated by 

20 the interpolating-position generating unit, by using a 
predetermined correcting formula including a polynomial 
obtained by linearly combining the integer power of the 
distance from the center of distortion to the interpolating 
position. 



25 
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15. The image processing apparatus according to Claim 

11 , wherein the distort ion-correcting-coordinate converting 
unit obtains coordinates in the image before correcting the 
distortion, corresponding to the coordinates generated by 

5 the interpolating-position generating unit, by using a 
predetermined correcting formula including a polynomial 
obtained by linearly combining the integer power of the 
distance from the center of distortion to the interpolating 
position. 

10 

16. The image processing apparatus according to Claim 

12, wherein the distortion-correcting-coordinate converting 
unit obtains coordinates in the image before correcting the 
distortion, corresponding to the coordinates generated by 

15 the interpolating-position generating unit, by using a 
predetermined correcting formula including a polynomial 
obtained by linearly combining the integer power of the 
distance from the center of distortion to the interpolating 
position . 

20 

17. The image processing apparatus according to Claim 

13, wherein the polynomial includes a term of a high degree 
of the distance, which is higher than the second degree. 

25 18. The image processing apparatus according to Claim 
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14, wherein the polynomial includes a term of a high degree 
of the distance, which is higher than the second degree. 

19. The image processing apparatus according to Claim 
5 15 f wherein the polynomial includes a term of a high degree 

of the distance, which is higher than the second degree. 

20. The image processing apparatus according to Claim 
16, wherein the polynomial includes a term of a high degree 

10 of the distance, which is higher than the second degree. 

21. The image processing apparatus according to Claim 

13, wherein the image processing unit further comprises 
another image processing unit other than the distortion 

15 correction processing unit, and 

the distortion-correcting-coordinate converting unit 
outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position . 

20 

22. The image processing apparatus according to Claim 

14, wherein the image processing unit further comprises 
another image processing unit other than the distortion 
correction processing unit, and 

25 the distortion-correcting-coordinate converting unit 
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outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position. 

23. The image processing apparatus according to Claim 

15 , wherein the image processing unit further comprises 
another image processing unit other than the distortion 
correction processing unit, and 

the distortion-correcting-coordinate converting unit 
outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position. 

24. The image processing apparatus according to Claim 

16, wherein the image processing unit further comprises 
another image processing unit other than the distortion 
correction processing unit, and 

the distortion-correcting-coordinate converting unit 
outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position. 

25. The image processing apparatus according to Claim 

17, wherein the image processing unit further comprises 
another image processing unit other than the distortion 
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correction processing unit, and 

the distortion-correcting-coordinate converting unit 
outputs , to the other image processing unit, information on 
the distance from the center of distortion to the 
5 interpolating position. 

26. The image processing apparatus according to Claim 

18, wherein the image processing unit further comprises 
another image processing unit other than the distortion 

10 correction processing unit, and 

the distortion-correcting-coordinate converting unit 
outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position. 

15 

27. The image processing apparatus according to Claim 

19, wherein the image processing unit further comprises 
another image processing unit other than the distortion 
correction processing unit, and 

20 the distortion-correcting-coordinate converting unit 

outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position. 

25 28. The image processing apparatus according to Claim 
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20, wherein the image processing unit further comprises 
another image processing unit other than the distortion 
correction processing unit, and 

the distortion-correcting-coordinate converting unit 
5 outputs, to the other image processing unit, information on 
the distance from the center of distortion to the 
interpolating position. 

29. The image processing apparatus according to Claim 
10 21, wherein the above-described another image processing 

unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 
processing unit. 

15 30. The image processing apparatus according to Claim 

22, wherein the above-described another image processing 
unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 
processing unit. 

20 

31. The image processing apparatus according to Claim 

23, wherein the above-described another image processing 
unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 

25 processing unit. 
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32. The image processing apparatus according to Claim 

24, wherein the above-described another image processing 
unit comprises at least one of a shading correcting unit, a 

5 low-pass filter processing unit, and an edge-emphasis 
processing unit. 

33. The image processing apparatus according to Claim 

25, wherein the above-described another image processing 

10 unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 
processing unit. 

34. The image processing apparatus according to Claim 
15 26, wherein the above-described another image processing 

unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 
processing unit. 

2 0 35. The image processing apparatus according to Claim 

27, wherein the above-described another image processing 
unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 
processing unit. 
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36. The image processing apparatus according to Claim 
28, wherein the above-described another image processing 
unit comprises at least one of a shading correcting unit, a 
low-pass filter processing unit, and an edge-emphasis 

5 processing unit. 

37. An image processing apparatus for performing image 
processing including distortion correction processing and 
enlarging and reducing processing, of electronic image data 

10 obtained by capturing an image via an optical system, the 
image processing apparatus comprising a distortion 
correction processing unit, the distortion correction 
processing unit comprising: 

an interpolating-coordinate generating unit that 

15 generates interpolating coordinate data, serving as 
coordinate data before interpolating processing, 
corresponding to the pixel position after the interpolating 
processing of the image processing including the distortion 
correction processing and the enlarging and reducing 

20 processing; 

a memory unit that stores at least a part of the image 

data; 

a memory control unit that controls the operation for 
partly writing the image data and the operation for reading 
25 the image data from the memory unit based on the 
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interpolating coordinate data; and 

an interpolation calculating unit that calculates for 
interpolation the image data read from the memory unit under 
the control operation of the memory control unit to generate 
5 the image data at the pixel position after the interpolating 
processing . 

38. The image processing apparatus according to Claim 
37, wherein the interpolating-coordinate generating unit 

10 comprises: 

an interpolating-position generating unit that 
generates an interpolating position , serving as coordinate 
data before the interpolating processing , corresponding to 
the pixel position after the interpolating processing 

15 associated with the image processing including the enlarging 
and reducing processing but not including the distortion 
correction processing and; 

a distortion-correcting-coordinate converting unit that 
generates the interpolating coordinate data, serving as 

20 coordinate data before the interpolating processing, 

corresponding to the pixel position after the interpolating 
processing associated with the image processing including 
the distortion correction processing, by using the 
interpolating position generated by the interpolating- 

25 position generating unit; and 
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a selector that selects an output of the interpolating- 
position generating unit in the case that the distortion 
correction processing is not performed, selects an output of 
the distortion-correcting-coordinate converting unit' in the 
5 case that the distortion correction processing is performed, 
and outputs the selected output to the memory control unit. 

39. The image processing apparatus according to Claim 
38, wherein the distortion-correcting-coordinate converting 
unit comprises : 

a distortion-correcting-coef f icient calculating unit 
that calculates a distortion correcting-coef f icient , serving 
a coefficient indicating the change in coordinates due to 
the distortion aberration of the optical system; and 

an interpolating-position correcting unit that corrects 
the interpolating position generated by the interpolating- 
position generating unit by using the distortion correcting 
coefficient calculated by the distortion-correcting- 
coefficient calculating unit to generate the interpolating 
coordinate data . 

40. The image processing apparatus according to Claim 
38, wherein the distortion correction processing unit 
operates by receiving a clock, and 

25 the distortion-correcting-coordinate converting unit in 
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the distortion correction processing unit receives a clock 
different from a clock supplied to a part other than the 
distortion-correcting-coordinate converting unit in the 
distortion correction processing unit. 

5 

41. The image processing apparatus according to Claim 
39 , wherein the distortion correction processing unit 
operates by receiving a clock, and 

the distortion-correcting-coordinate converting unit in 
10 the distortion correction processing unit receives a clock 
different from a clock supplied to a part other than the 
distortion-correcting-coordinate converting unit in the 
distortion correction processing unit. 

15 42. The image processing apparatus according to Claim 

38, wherein the distortion correction processing unit 
operates by receiving a clock, and 

the interpolating-position generating unit, or the 
interpolating-position generating unit and the distortion- 

20 correcting-coordinate converting unit generate the 

interpolating position, or generate the interpolating 
position and generate the interpolating coordinate data at 
an interval of clocks, not every clock. 

25 43. The image processing apparatus according to Claim 
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39, wherein the distortion correction processing unit 
operates by receiving a clock, and 

the interpolating-position generating unit, or the 
interpolating-position generating unit and the distortion- 
5 correcting-coordinate converting unit generate the 

interpolating position, or generate the interpolating 
position and generate the interpolating coordinate data at 
an interval of clocks, not every clock. 

10 44. The image processing apparatus according to Claim 

40, wherein the distortion correction processing unit 
operates by receiving a clock, and 

the interpolating-position generating unit, or the 
interpolating-position generating unit and the distortion- 
15 correcting-coordinate converting unit generate the 

interpolating position, or generate the interpolating 
position and generate the interpolating coordinate data at 
an interval of clocks, not every clock. 

20 45. The image processing apparatus according to Claim 

41, wherein the distortion correction processing unit 
operates by receiving a clock, and 

the interpolating-position generating unit, or the 
interpolating-position generating unit and the distortion- 
25 correcting-coordinate converting unit generate the 
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interpolating position , or generate the interpolating 
position and generate the interpolating coordinate data at 
an interval of clocks, not every clock. 

5 46. The image processing apparatus according to Claim 

38, wherein the distortion-correcting coordinate converting 
unit generates the interpolating coordinate data based on a. 
practical formula obtained by modifying a basic formula such 
that the number of multiplying times in the practical 

10 formula is fewer than that in the basic formula. 

47 . The image processing apparatus according to Claim 

39, wherein the distortion-correcting coordinate converting 
unit generates the interpolating coordinate data based on a 

15 practical formula obtained by modifying a basic formula such 
that the number of multiplying times in the practical 
formula is fewer than that in the basic formula. 

48. The image processing apparatus according to Claim 
20 40, wherein the distortion-correcting coordinate converting 

unit generates the interpolating coordinate data based on a 
practical formula obtained by modifying a basic formula such 
that the number of multiplying times in the practical 
formula is fewer than that in the basic formula. 



25 
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49. The image processing apparatus according to Claim 

41 , wherein the distortion-correcting coordinate converting 
unit generates the interpolating coordinate data based on a 
practical formula obtained by modifying a basic formula such 

5 that the number of multiplying times in the practical 
formula is fewer than that in the basic formula, 

50. The image processing apparatus according to Claim 

42 , wherein the distortion-correcting coordinate converting 
10 unit generates the interpolating coordinate data based on a 

practical formula obtained by modifying a basic formula such 
that the number of multiplying times in the practical 
formula is fewer than that in the basic formula. 

15 51. The image processing apparatus according to Claim 

43, wherein the distortion-correcting coordinate converting 
unit generates the interpolating coordinate data based on a 
practical formula obtained by modifying a basic formula such 
that the number of multiplying times in the practical 

2 0 formula is fewer than that in the basic formula. 

52. The image processing apparatus according to Claim 

44, wherein the distortion-correcting coordinate converting 
unit generates the interpolating coordinate data based on a 

25 practical formula obtained by modifying a basic formula such 
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that the number of multiplying times in the practical 
formula is fewer than that in the basic formula. 

53. The image processing apparatus according to Claim 
5 45, wherein the distortion-correcting coordinate converting 

unit generates the interpolating coordinate data based on a 
practical formula obtained by modifying a basic formula such 
that the number of multiplying times in the practical 
formula is fewer than that in the basic formula. 

10 

54. The image processing apparatus according to Claim 
39 , wherein the distortion-correcting-coef f icient 
calculating unit calculates the distortion correcting 
coefficient based on the distance between the center of 

15 distortion and the position corresponding to the target 
pixel in the image after correcting the distortion, and 
performs at least a part of the calculation processing by 
the calculation using a floating decimal. 

20 55. The image processing apparatus according to Claim 

54, wherein the distortion-correcting-coef f icient 
calculating unit comprises a look-up table for storing a 
corresponding relationship between the square of the 
distance and the distortion correcting coefficient, and 

25 obtains the square of the distance by the calculation 
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using a floating decimal, and calculates the distortion 
correcting coefficient by referring to the look-up table 
based on the obtained square of the distance. 

56. An image processing apparatus for processing 
electronic image data obtained by capturing an image via an 
optical system, the image data comprising a plurality of 
components, the image processing apparatus comprising a 
distortion correction processing unit, the distortion 
correction processing unit comprising: 

a distortion-correcting-coef f icient calculating unit 
that calculates, every component, a distortion correcting 
coefficient used for correcting the distortion aberration 
due to the optical system based on the distance from the 
center of distortion; and 

a distortion-correction calculating unit that corrects 
the distortion of the image data every component by using 
the distortion correcting coefficient every component 
calculated by the distortion-correcting-coef f icient 
calculating unit. 

57 . The image processing apparatus according to Claim 
56, wherein the distortion-correction calculating unit 
comprises a plurality of the distortion-correction 
calculating units that are arranged with a one-to-one 
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corresponding relation of all components forming the image 
data . 

58. The image processing apparatus according to Claim 
5 57, wherein the distortion correction calculating unit 

comprises an inner buffer that stores the image data, and 
outputs a starting request of the distortion correction 
processing when the image data necessary for the distortion 
correction processing is stored in the inner buffer , and 

10 the distortion correction calculating unit further 

comprises a grant synchronizing unit that controls the 
operation such that the distortion correction processing 
starts for all of the plurality of distortion correction 
calculating units after collecting the starting requests of 

15 the distortion correction processing from all the distortion 
correction calculating units. 

59 . The image processing apparatus according to Claim 
58, wherein the grant synchronizing unit controls the 

20 operation such that all the distortion correction 

calculating units start the distortion correction processing 
by outputting a grant signal for granting calculating 
processing of the distortion correcting coefficient to the 
distortion-correcting-coef f icient calculating unit and by 

25 starting the calculation of the distortion correcting 



- 117 - 



coefficients for all components of the distortion- 
correcting-coeff icient calculating units. 

60. The image processing apparatus according to Claim 

56 , wherein the distortion-correcting-coeff icient 
calculating unit has at least one part that is commonly used 
for all components upon calculating the distortion 
correcting coefficient every component. 

61. The image processing apparatus according to Claim 

57 , wherein the distortion-correcting-coeff icient 
calculating unit has at least one part that is commonly used 
for all components upon calculating the distortion 
correcting coefficient every component. 

62. The image processing apparatus according to Claim 

58 , wherein the distortion-correcting-coeff icient 
calculating unit has at least one part that is commonly used 
for all components upon calculating the distortion 
correcting coefficient every component. 

63. The image processing apparatus according to Claim 

59, wherein the distortion-correcting-coeff icient 
calculating unit has at least one part that is commonly used 
for all components upon calculating the distortion 
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correcting coefficient every component. 

64. The image processing apparatus according to Claim 

60, wherein the distortion-correct ing-coefficient 

5 calculating unit calculates the square of the distance from 
the center of distortion, and obtains the distortion 
correcting coefficient every component based on the square 
of the distance, and 

the portion commonly-used for all components calculates 
10 the square of the distance from the center of distortion. 

65. The image processing apparatus according to Claim 

61, wherein the distortion-correcting-coef f icient 
calculating unit calculates the square of the distance from 

15 the center of distortion, and obtains the distortion 

correcting coefficient every component based on the square 
of the distance, and 

the portion commonly-used for all components calculates 
the square of the distance from the center of distortion. 

20 

66. The image processing apparatus according to Claim 

62, wherein the distortion-correcting-coef f icient 
calculating unit calculates the square of the distance from 
the center of distortion, and obtains the distortion 

25 correcting coefficient every component based on the square 
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of the distance, and 

the portion commonly-used for all components calculates 
the square of the distance from the center of distortion. 

67 . The image processing apparatus according to Claim 

63 , wherein the distortion-correcting-coef f icient 
calculating unit calculates the square of the distance from 
the center of distortion, and obtains the distortion 
correcting coefficient every component based on the square 
of the distance, and 

the portion commonly-used for all components calculates 
the square of the distance from the center of distortion. 

68. The image processing apparatus according to Claim 

64, wherein the distortion-correcting-coef f icient 
calculating unit comprises, for each of the components, a 
look-up table that stores a corresponding relationship 
between the square of the distance from the center of 
distortion and the distortion correcting coefficient, and 

obtains, every component, the distortion correcting 
coefficient based on the calculated square of the distance 
by referring to the look-up table for each of the components 

69. The image processing apparatus according to Claim 

65, wherein the distortion-correcting-coef f icient 
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calculating unit comprises, for each of the components, a 
look-up table that stores a corresponding relationship 
between the square of the distance from the center of 
distortion and the distortion correcting coefficient, and 
5 obtains, every component, the distortion correcting 

coefficient based on the calculated square of the distance 
by referring to the look-up table for each of the components. 

70. The image processing apparatus according to Claim 
10 66, wherein the distortion-correcting-coef f icient 

calculating unit comprises, for each of the components, a 
look-up table that stores a corresponding relationship 
between the square of the distance from the center of 
distortion and the distortion correcting coefficient, and 
15 obtains, every component, the distortion correcting 

coefficient based on the calculated square of the distance 
by referring to the look-up table for each of the components. 

71. The image processing apparatus according to Claim 
20 67, wherein the distortion-correcting-coef f icient 

calculating unit comprises, for each of the components, a 
look-up table that stores a corresponding relationship 
between the square of the distance from the center of 
distortion and the distortion correcting coefficient, and 
25 obtains, every component, the distortion correcting 
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coefficient based on the calculated square of the distance 
by referring to the look-up table for each of the components. 



